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I.  Introduction 


In  this  paper  we  consider  the  multiple-access  capability  of  frequency-hop 
spread-spectrum  communication  systems  from  an  information  theoretic  view¬ 
point.  This  capability  is  calculated  by  modelling  the  communication  system 
from  the  modulator  input  to  the  demodulator  output  as  an  interference  channel 
and  determining  the  capacity  region  of  this  channel.  We  examine  synchronous 
and  asynchronous  hopping  patterns  and  consider  the  cases  of  side  information 
at  the  receiver  and  no  side  information  at  the  receiver. 

There  have  been  several  recent  studies  of  multiple-access  performance  of 
spread-spectrum  communication  systems  [1,3].  These  have  concerned  themselves 
with  the  probability  of  error  of  packets  or  codewords  over  such  multiple-access 
channels  using  specific  codes,  typically  Reed-Solomon  codes.  For  the  (much 
harder  to  analyze)  unslotted  channel  they  have  used  bounding  techniques  to  ap¬ 
proximate  the  packet  or  codeword  error  probability  [4].  In  this  paper  we  address 
the  issue  of  performance  with  the  best  possible  codes.  Here  we  examine  only  the 
slotted  channel  with  both  synchronous  and  asynchronous  hopping  each  with  and 
without  side  information  and  determine  the  capacity  region. 

We  do  not  allow  cooperation  between  users  either  at  the  encoder  or  at  the 
decoder.  This  makes  the  interference  channel  model  more  appropriate  to  our 
situation  rather  than  the  multiple-access  channels.  Using  this  model  we  are  able 
to  calculate  the  capacity  region  in  each  of  the  cases  mentioned  above.  We  then 
focus  our  attention  on  the  largest  possible  total  rate  that  can  be  achieved  by  all 


users. 


II.  Channel  Models 

The  model  for  multiple-access  frequency-hop  spread-spectrum  communica¬ 
tion  consists  of  K  source-receiver  pairs  with  the  t-th  source  desiring  to  commu¬ 
nicate  only  with  its  corresponding  receiver  over  a  common  channel  (See  Fig.  l). 
There  are  K  separate  encoder  devices:  one  for  each  source.  The  i-th  encoder 
has  as  its  input  only  the  messages  from  the  t-th  source  and  produces  a  symbol 
*(')  €  X  (the  common  input  alphabet).  This  symbol  is  transmitted  by  mod¬ 
ulating  and  frequency-hopping  the  desired  symbol.  The  t-th  receiver  examines 
its  assigned  hopping  pattern  demodulates  the  received  waveform  and  produces 
the  output  symbol  €  Y  (the  common  output  alphabet).  Decoding  is  done 
independently  at  the  t-th  receiver.  The  t-th  source  may  transmit  one  of  [2nil,  J 
messages  and  this  is  then  encoded  by  the  t-th  encoder,  modulated  using  one  of 
M  signals,  and  then  frequency  hopped  by  the  t-th  frequency  hopper  to  one  of  q 
frequency  slots.  The  hopping  patterns  are  modelled  by  independent  sequences 
equiprobable  over  the  q  slots.  Thus  each  component  of  each  of  the  K  input  vec¬ 
tors  of  length  n  is  chosen  from  the  common  alphabet  {1, 2, ...,  M}.  We  assume  / 
channel  symbols  are  transmitted  per  hop  and  this  in  incorporated  into  the  chan¬ 
nel  alphabet  size  M.  We  assume  that  the  channel  is  slotted  and  thus  the  number 
of  transmissions  during  a  slot  is  constant. 

The  hopping  patterns  we  consider  are  modelled  by  independent  sequences, 
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one  for  each  sender-receiver  pair,  equiprobable  over  the  q  slots.  In  the  case  of 
synchronous  hopping  this  makes  the  channel  hits  (i.e.  the  event  of  more  than  one 
user  transmitting  over  the  same  frequency  slot)  independent.  However,  in  the 
case  of  asynchronous  hopping  patterns,  knowledge  about  past  hits  by  a  particular 
user  affects  this  user’s  knowledge  about  the  distribution  of  the  frequency  slots 
used  by  the  K  —  1  other  users  and  so  the  sequence  of  hits  for  any  particular 
user  exhibits  memory.  Moreover,  it  turns  out  that  this  sequence  is  not  even 
Markovian  [5].  In  this  paper  we  demonstrate  that  this  sequence  is  a  function  of 
an  underlying  Markov  chain  which  enables  us  to  treat  the  marginal  channels  in 
the  asynchronous  case  as  finite  state  channels  thereby  allowing  us  to  compute 
the  capacity  regions  of  the  /f-user  channel  with  asynchronous  hopping  in  both 
the  case  with  side  information  at  the  receiver  (knowledge  about  whether  each 
received  symbol  was  hit  or  not)  and  the  case  with  no  side  information  at  the 
receiver.  We  consider  only  the  noise  arising  from  interference  due  to  other  users 
and  do  not  include  any  other  background  noise  in  our  analysis  (although  it  would 
not  be  difficult  to  do  so). 

Case  A:  Synchronous  Hopping-Side  Information  Available 

We  first  examine  the  case  of  synchronous  hopping  patterns  and  thus  consider 
a  memoryless  channel  model  (since  the  symbol  hits  are  independent  in  this  case). 
The  side  information  referred  to  is  the  awareness  of  each  of  the  K  decoders  about 
whether  or  not  there  was  a  hit  on  the  corresponding  transmission.  The  symbols 
hit  are  erased.  This  model  is  shown  in  Fig.  2(a).  It  is  easy  to  see  that 


3 


—  /’{erasure}  =  1  -  (1  -  p)K~l 


(1) 


where  p  =  1/q. 

Case  B:  Synchronous  Hopping-No  Side  Information  Available 

Here  again  synchronous  hopping  is  considered  but  in  this  case  the  decoders 
do  not  receive  any  information  about  hits  on  each  symbol.  Thus  the  hits  remain 
undetected  and  cause  a  symbol  error  with  probability  eo  (see  Fig.  2(b)) 

eB/(M  -  1  )=P{error)  =  (1  -  (1  -  p)K~l)eo/{M  -  l).  (2) 

Note  that  in  our  model  we  do  not  distinguish  between  the  case  of  two  users 
colliding  or  more  than  two  users  colliding. 

Case  C:  Asynchronous  Hopping-Side  Information  Available 

We  now  address  the  situation  where  the  hopping  is  asynchronous  and  the 
receivers  have  side  information  which  enables  the  demodulator  and  decoder  to 
determine  which  symbols  have  been  hit.  It  is  assumed  that  all  symbols  that  have 
been  hit  are  erased.  We  need  to  introduce  some  notation  which  we  do  with  the  aid 
of  Fig.  3.  Each  user  employs  a  hopping  pattern  with  frequencies  chosen  uniformly 
from  the  set  {1,  ...,g}  and  independently  of  the  frequencies  chosen  by  the  other 
users.  We  denote  the  random  hopping  pattern  for  user  i  as  {Fij,  j  =  0,1,...}. 
(All  capital  letters  will  denote  random  quantities  (variables  or  vectors),  and 
the  corresponding  lower-case  letters  will  denote  particular  realizations  of  these 
random  quantities).  Observe  that  2  channel  symbols  of  user  i  overlap  with  the 
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j-th  channel  symbol  of  user  1.  We  define  the  frequency  possibly  interfering  with 
the  transmission  by  user  one  in  the  j-th  hop  on  the  right  (see  Fig.  3)  as  Ft  ] 
and  (Fjj, Fkj)  as  Fj.  Now  suppose  ail  K  users  are  transmitting  packets  and 
receiver  1  (which  desires  to  receive  user  l’s  messages)  locks  onto  user  l’s  hopping 
pattern.  We  assume  that  user  1  transmits  using  frequencies  Flj5  FjtJ, ..,  Fn  j.  We 
denote  by  Hj,  j  —  1,  ...,n,  n  binary  random  variables  such  that  Hj  =  1  if  the  j-th 
symbol  transmitted  by  user  1  is  hit  (i.e.  if  at  least  one  of  the  other  K  -  1  users 
uses  the  same  frequency  during  the  slot  corresponding  to  the  jth  channel  symbol) 
and  Hj  =  0  otherwise.  We  note  that  Hj  =  1  if  and  only  if  F1;  e  F,_,  U  Fj.  We 
also  will  need  the  binary  random  variables  Hj,  Hj *,  j  =  1,2,  ...,n  defined  as 
follows 


Fij  €  Fj- 1 
otherwise, 


Fu  e  Fj 


[  0  otherwise. 

Finally,  let  S-  be  the  number  of  frequency  slots  out  of  time  slots  i,i  + 
of  user  1  that  have  been  hit. 

Note  that  in  the  model  we  have  just  described  the  set  {F< j\  *  =  1,2, ...,  K,  j  = 
0,1,..., n}  is  an  independent  identically  distributed  (i.i.d.)  set  of  random  vari¬ 
ables  with  each  F<J  being  uniformly  distributed  on  the  set  1,2,  ...,g  and  conse- 

m  t 

quently  { Fj ;  j  =  0,1,.. .,n)  is  an  i.i.d.  sequence.  Also  Hj  =  1  if  and  only  if 
Hj  =  1  or  Hj1  =  1  and  Sj  =  Hi  +  ...  +  Hj.  Now  we  can  state  our  key  lemma. 
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Lemma  1:  The  sequence  (Hf,  Hf)  is  a  Markov  chain. 

Proof:  See  Appendix  A. 

Note:  In  the  sequence  (...Hf_1,Hf_l,Hf,Hf ,...),  Hf  depends  on  Hf_x  but  is 
independent  of  Hf_x  and  Hf.  The  reason  why  H,  is  not  a  Markov  chain  (for 
K  >  2)  is  that  knowledge  of  Hj- j, ...  affects  our  posteriori  distribution  of 
Fk,  k  =  j  -  1J  -  2, ...  and  thereby  Hf_x  thus  making 

*  P(Hj\Hj.x). 

Since  Hj  =  (Hf  or  Hf)  we  recognize  that  the  sequence  of  symbol  hits  is  really 
a  function  of  the  underlying  stationary  Markov  chain  ( Hf,Hf )  with  four  states 
viz.  (Hf,  Hf)  =  (0,0),  (0, 1),  (1,0),  or  (1, 1).  For  the  sake  of  brevity  we  use  uf'1 
to  denote  the  state  of  the  component  channel  between  the  t-th  sender  and  the 
corresponding  receiver  during  the  j-th  symbol  transmission  i.e.  Pf  = 
for  the  t-th  component  channel. 

This  Markov  chain  is  shown  in  Fig.  4  and  the  transition  probabilities  are 
calculated  in  Appendix  B.  In  the  K-uaer  situation  each  of  the  K  component 
channels  (between  the  t-th  sender  and  the  corresponding  receiver)  is  thus  a  finite 
state  channel.  Corresponding  to  state  a=(0,0)  we  have  a  noiseless  channel  and 
corresponding  to  states  6=(0,1),  c=(l,0)  or  d=(l,l)  (i.e.  a  hit  on  the  current 
symbol)  we  have  a  channel  which  puts  out  an  erasure  symbol. 

Case  D:  Asynchronous  Hopping  -  No  Side  Information  Available 

Finally  we  address  the  case  where  the  hopping  is  asynchronous  and  the  de¬ 
coders  receive  no  information  about  whether  a  symbol  is  hit  or  not.  Hits  are 
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thus  undetected  and  cause  errors  with  probability  e0-  The  component  channel 
in  this  case  may  be  modelled  as  an  M-ary  input  M-ary  output  channel  where 
the  output  letters  Yj  associated  with  the  input  AT,-  are  given  by  F,  =  AT,  © 
where  Hj  is  the  random  variable  (defined  earlier)  which  is  1  if  the  j-th  sym¬ 
bol  was  hit  and  is  0  otherwise  and  Rj  is  a  random  variable  independent  of  the 
input  and  independent  of  Hj  with  a  distribution  on  {0, -  1}  such  that 
P(Rj  =  0)  =  1  —  «o  and  P{Rj  =  /)  =  eo /(M  —  1)  for  l  =  1,2,  ...,M  -  1.  Finally 
the  addition  ©  is  modulo  M  addition. 

III.  Capacity  Regions 

We  observe  that  in  both  the  synchronous  cases  our  models  are  a  simple  case 
of  a  K-user  discrete  memoryless  interference  channel,  i.e.  a  channel  characterized 
by  a  probability  density  ...jyWjx*1*,  ...,1^)  with  the  *-th  sender  trying 

to  communicate  with  the  t-th  receiver  through  independent  encoders  and  de¬ 
coders.  The  capacity  region  for  such  channel  is  not  known  in  general  but  various 
inner  and  outer  bounds  have  been  developed  for  it  [6).  Our  channels  fall  into 
a  simple  class  known  as  separated  channels  for  which  the  marginal  probabilities 
p(yW\xW,  ...,!<*))  do  not  depend  on  xM  j  ^  *,  i.e. 

p(y(<)|x(l),...,xw)  =  p(y(’)|x(,)). 

Since  the  capacity  region  depends  only  upon  the  marginal  probabilities  lx*1*, . 
we  see  from  the  converse  to  the  coding  theorem  for  the  two  user  channel  that  the 
maximum  rate  of  reliable  transmission  for  the  ith  sender-receiver  pair  cannot  be 


,xW) 
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more  that  maxg,  /(A-,;  Yi)  where  X<  and  are  related  by  the  conditional  proba¬ 
bility  distribution  p(yW|*W).  This  rate  can  be  actually  achieved  by  maximizing 
each  Qi  individually  and  hence  we  see  that  the  capacity  region  is 

0  <  Ri  <  Ci  (3) 


where  C<  =  maxg,  I(Xi;Yi). 

In  the  asynchronous  case  we  similarly  see  that 


p(v{VK . 


u(K))  =  p(yM  |*Wy«)) 


where  the  u^’s  are  the  states  of  the  underlying  Markov  chain  corresponding  to 
the  t-th  sender-receiver  pair.  Thus  again  from  the  converse  to  the  coding  theorem 
for  the  single  user  channel  (9]  the  maximum  rate  of  reliable  information  trans¬ 
mission  cannot  be  more  than  the  capacity  of  this  finite  state  two  user  channel. 
Since  we  can  actually  achieve  this  rate  by  suitable  choice  of  input  probabilities 
(in  fact,  by  i.i.d.  inputs)  we  see  that  the  capacity  region  of  this  communication 
system  is 


0  <Ri<Ci,  l<i<K 


(4) 


where  C,  is  the  capacity  of  the  finite  state  channel  corresponding  to  the  ith 
sender-receiver  pair. 

We  now  calculate  the  interference  capacities  for  the  models  described  above. 
Case  A:  (Synchronous  Hopping,  Side  Information  Available) 


Ri  <  Ci  =  (1  -  €A)  log, M,  i  = 


(5) 


where  q  is  fixed.  The  sum  of  the  rates  of  the  individual  users,  R,um  =  1  J2«, 

is  maximized  by 


K* 


-1 

ln(l  -  p) 


for  which  the  sum  rate  is 


R.um  <  C,um  =  £)  C.  =  log,  M. 

faS  ln(l  -  p)  1  -  p 


For  large  q  the  optimum  number  of  users  approaches  q,  i.e. 


T * 

lim  —  =  1 

«-» oo  g 


(6) 


and 


lim 

f-*00 


r*c< 
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e_l  log,  M. 


(7) 


Case  B:  (Synchronous  Hopping,  No  Side  Information  Available) 


R-i  <  Ci  =  logj  Af  -  AM(Cfl),  t  =  1,  ...» Af  (8) 


and 


Rium  ~  C'nim  —  tf(log,  Af  -  Am(£b)) 


(9) 


where 


Am(x)  =  -ilogM(x/(Af  -  1))  -  (1  -  x)  logM(l  -  x). 


(10) 


The  limiting  sum  capacity  for  M  =  2  and  K  =  Xq  with  A  fixed  is 


ft  £j=-*(i (ii) 

Optimizing  the  above  over  A  gives  A*  =  0.46  and  lim,_oo  =  0.143. 

Case  C:  (Asynchronous  Hopping,  Side  Information  Available) 

The  channel  model  for  the  i-th  user  is  a  finite  state  channel  with  four  states 
a,  b,  c  and  d.  Since  the  Markov  chain  £/,  =  (Hj',  Hf)  is  ergodic  and  its  state 
sequence  is  independent  of  the  input  we  see  that  our  channel  model  belongs  to 
the  class  of  indecomposable  finite-state  channels  with  no  intersymbol  interference 
memory.  We  calculate  the  capacity  C,  of  the  Ith  component  channel  as  follows 
(see  (®J). 


„  .  /<}(*";  n«o) 

Ci  =  Inn  max  mm  — s-i - - — - 

00  q„(«")  “«  n 

where  Qn(.)  is  some  n-dimensional  joint  density  on  the  input  and  Uq  is  some 
initial  state  of  the  Markov  chain  Since  the  channel  is  indecomposable 

and  therefore  C,  is  independent  of  the  initial  state  of  the  Markov  chain  and  may 
be  written  as 


Ci  - 


lim  max 


I0(X";r"|«o) 

n 


for  any  initial  state  uo>  Now 


/<,(*";  y"|«o)  =  H(Yn\u0)-H{Yn\Xn,u0) 


and 
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ff(r’luo)  <  »(Mi  -  p(y>0  =?l*?)  =  *)) 

■  with  equality  achieved  by  equally  inputs  where  h*i{x)  is  given  in  (10)  and  p(yj }  = 

?!,«  =  k)  =  1-(1- J)1(jr_1)  and  k  and  *  are  arbitrary.  Denoting  p(y j0  =?|*S‘)  = 

k)  as  «c.  we  have 

Jf(r’,|-*n>t*o)  =  n\-ec  logM  ec  -  (1  -  «c)  logM(l  -  cc)]- 
Now  it  is  easy  to  verify  that 

•  - 

i 

Ci  =  (1  -  €C)  logM(M  -  1). 

Hence 

^  ft  <  Ci  =  {1  —  (l  —  (1  —  i)J(ir“^l>  log,  A/,  i  =  l . K  (12) 

is  the  capacity  region  of  the  JC-user  channel  in  this  case.  Asymptotically  as  the 
■  number  of  frequency  slots,  q,  approaches  infinity  with  K  =  A q,  (A  some  constant) 

we  get 

(1  -  (1  -  (1  -  i)«*-‘>))  -  1  -  (1  -  «'")  =  (13) 

Hence,  asymptotically  C<  =  e~u  log,  Af.  Optimizing 

lim  C„m/q  =  lim  £  Ct/q  =  Ae"aA  log,  M 
,-*00  ,-*00  “ 

over  A  gives  A*  =  0.5  and  lim,-*oo  =  1 
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Case  D:  (Asynchronous  Hopping,  No  Side  Information  Available) 

In  this  case  with  asynchronous  hopping  and  no  side  information  available  we 
calculate  the  capacity  C,  of  the  i1k  component  channel  using,  as  in  Case  C, 

C,  =  lim  max  min-^— 

“0  n 

Again  since  the  channel  is  indecomposable  C<  is  independent  of  the  initial  state 
of  the  Markov  chain  and  may  be  written  as 


C,  =  lim  max 


|tto) 


n 


for  any  initial  state  u0.  Now 


/Q(^";yn|«o)  =  ff(n«o)-ff(nA",uo) 

=  H(rn|tto)  -  H(Kn|u0) 

where  V„  is  a  1  if  an  error  occurred  on  the  n-th  symbol  and  is  0  otherwise.  Hence 

Ci  =  lim  max  =  log  M  -  H^V)  (13) 

since  H(Kn|tio)  <  n  log  M  with  equality  for  equally  likely  outputs  which  are 
achieved  by  equally  likely  inputs  and  since  limn_00  £/f(Vn|uo)  is  independent 
of  uo  and  is  equal  to  Hoo{V),  i.  e.  the  entropy  of  the  stationary  random  (non- 
Markovian)  process  {V,}  which  is  a  function  of  the  Markov  chain,  {{Hf',  Hf,  JR,)}. 

Computing  the  entropy  of  a  function  of  a  Markov  process  has  been  con¬ 
sidered  by  Blackwell  [11].  While  a  closed  form  expression  for  the  capacity  is 
not  available  in  our  case,  tight  upper  and  lower  bounds  are  available  [12].  Let 


u 


■ 


Wj  =  J?y)  be  the  state  of  a  Markov  chain  and  V,  the  function  of  the 

state  given  by  Vy  =  1  if  Hj“  =  Hf  =  1  and  Rj  ^  0  and  Vy  =  0  otherwise.  Then 
the  entropy  H^V)  of  Vy  is  bounded  as  follows. 

H(Vn\Vn-U  Vn-„...,VltW0)  <  H^V)  <  H{Vn\Vn-uVn.t%...,Vx). 


Furthermore  these  bounds  converge  expontially  fast  in  n  to  H^V).  From  [12] 
it  can  be  seen  that  the  difference  between  the  upper  and  lower  bounds  above  is 
less  than  Dpn~l  where 


ND  loge 

Nx  minij  m,  j  ’ 


Nx  and  Np  are  the  minimum  and  maximum  number  of  states  colasped  repectively 
by  the  function  of  the  Markov  chain  (in  our  case  Nx  =  M  -  1,  ND  =  3 M  +  1), 
rriij  is  the  transition  probabliity  of  the  Markov  chain  W  and 


0  <  p  = 


,  Nx  mifkmk<n 

1  -  min  - — 


<  1. 


In  our  model  this  convergence  is  especially  rapid  since  for  most  parameters  of 
interest  the  Markovian  dependence  of  Wj  on  Wy_i  is  very  "weak”,  i.e.  the  tran¬ 
sition  probabilities  are  almost  independent  of  the  previous  state.  If  fact  our 
numerical  results  show  that  the  upper  and  lower  bound  are  essentially  identical 
for  n  =  2,  even  for  moderate  values  of  q.  (For  q  =  50  the  upper  and  lower  bounds 
agree  out  to  more  than  8  significant  digits).  In  Appendix  C  we  show  a  sample 
calculation  of  the  entropy  used  in  the  upper  and  lower  bounds. 

If  we  let  q  — »  oo  with  K  =  Ag(A  constant)  we  see  that  the  stationary  dis¬ 
tribution  of  the  Markov  chain  {[/<}  tends  to  the  the  conditional  distribution 
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P{Ui\Ui-i)  With  P(U,  =  00)  =  1  =  01)  =  P{Uj  =  10)  =  e-A(l-e-A) 

and  P(Uj  =  11)  =  (1  -  e_A)1.  Thus  for  large  q  (and  K  =  Aq)  the  C/»  become 
independent.  Thus  for  the  case  of  errors  occurring  with  probability  (M  -  1  )/M 
given  a  hit  occurs,  asymptotically  as  K  and  q  become  large  with  K/q  —*  A 

^  =  A(logM-M«-,A)).  (H) 

9 

Now  it  is  easy  to  see  that  the  asymptotic  normalized  capacity  of  this  asynchronous 
case  is  exactly  half  of  the  synchronous  normalized  capacity  when  optimized  over 
A. 

IV.  Numerical  Results  and  Conclusions 

In  Fig.  5  we  show  the  sum  capacity  for  the  case  of  synchronous  hopping  with 
q  =  50  and  M  =  2  while  in  Fig.  6  we  show  the  sum  capacity  for  the  case  of 
asynchronous  hopping  with  q  =  50  and  M  =  2.  When  there  is  no  side  information 
the  errors  are  assumed  to  occur  with  probability  1/2.  A  careful  examination  of 
the  numerical  results  show  that  q  need  not  be  very  large  for  the  asymptotic 
results  to  give  a  very  accurate  approximation  to  the  capacity  of  these  channels. 
Also  the  asymptotic  value  for  the  optimum  number  of  simultaneous  users  is  a 
good  approximation  for  the  actual  value  for  finite  q.  For  the  asynchronous  case 
without  side  information  the  upper  and  lower  bounds  were  virtually  identical  for 
the  case  of  q  =  50.  The  tightness  of  the  bounds  is  due  to  the  fact  that  for  even 
reasonable  values  of  q  the  sequence  of  errors  in  the  channel  is  essentially  an  i.i.d. 
process. 


14 


In  this  paper  we  have  determined  the  multiple-access  capability  of  frequency- 
hopped  spread-spectrum  for  four  different  models.  The  interference  is  either 
modeled  as  causing  errors  with  a  given  probability  when  two  users  hopped  to 
the  same  frequency  at  the  same  time  or  as  causing  erasures.  The  key  result  was 
identifying  the  underlying  Markov  chain  or  ( ).  Using  the 

Markovian  properties  of  the  underlying  process  allows  one  to  recursively  compute 
the  error  probabilities  of  block  codes  for  these  channels  (see  [8])  and  for  channels 
with  combinations  of  errors  and  erasures. 
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APPENDIX  A 


Lemma  I:  is  a  Markov  chain. 

Proof: 

T3(  rjL  ttR  I  jtL  ttR  tjL  rjR  rrL  r tR  \ 

r\tlj  "j-Ji  “  j-H  "H’  '  •  V 

P(g^  fl,«,  H*  ..  gf_„  Bf_„  H« . ) 

/>(!!*„  fl,*  „«+„  Hji . ) 

=  5  (»y)- 

We  write  A  as  follows. 

A  =  P{Fij  ef  Fj-i,Fij  e f  Fj,Fij-i  ejLi  Fj.ttFij-i  €*_!  P',-1 .  •  •) 

where  €*  is  €  if  Hf  =  1  and  £  if  Hf  =  0  and  €f  is  €  if  JET*  =  1  and  £  if  /f*  =  0. 
Now 

>1  =  zL  f’O'Vi  €f  Fj-uFij  Fj,Fij-i  ef  Fj-i,Fij-i  ef_,  F,-i, . . .  |F1;_i  = 

A.y-i 

JWj-l  =  tu- 1) 

=  E  P(Fu  ef  e?  Fj./m-!  e*  F,.„ Aj-.  ef  F,.,...); 

Aj-.  * 

=  E  P(Fu  ef  Fi-..Fij  €?  €*  ,  F,-|) 

Aj-l 

■P{f\j-i  Zj-i  Fj-^Fij-i  ef_2  Fij  -  •)- 

using  the  independence  of  Fljt  Pij-i.  Fij-i,  F,,  F,_i,  F,-j, ...  in  the  last  equality. 
Now  from  the  fact  the  Fj  for  each  user  *  is  a  random  variable  uniformly  dis¬ 
tributed  over  the  set  {!,... q)  and  F,,  and  Fk>,  are  independent  and  identically 
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t 


distributed  for  t  ^  k  we  see  that  P{Fij  ef  Fj-i, Fi}  ef  //,/ij-i  F;_x)  is 

functionally  independent  of  fij-i-  Thus 


F{Fij  Fj-i,Fij  ef  F>,/ij_i  e}L_t  Fj-i) 

J2  €j-i  FJf-j,Fii>-2  F;-j . . .) 

q 

=  P(Fij  G;  Fj-uFij  ef  Fj,f ij-i  €f_x  F,_x) 

P(Pu-t  £>-i  Fj-j.Fxj- 2  e^_2  Fj-i...). 


Similarly  it  can  be  seen  that 

P  =  P(/t,j-i  ef-i  Pj-i)P(Fx,,_i  G^_x  Fj-j,  F\j-2  ef-i  Fj-i . . .) 

and  so 

A  _  F(Ft|i  €f,x  Fj-i,Fij  ef  Fj,  fU-i  Gf_x  Fj-i) 

B  P{fu. x  Gf.x  F;_x) 

=  P(Hf,Hf  | 


Clearly  |  HjLt,H?_t)  will  also  be  equal  to  P{H$,H?  |  Hf Thus 

the  Lemma  follows. 
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APPENDIX  B 


I 


In  this  appendix  we  calculate  the  stationary  probability  distribution  and  transi¬ 
tion  probabilities  for  the  Markov  chain  shown  in  Fig.  5.  We  will  show  how  to 
calculate  the  stationary  probability  for  one  particular  state.  The  calculations  for 
the  other  states  are  similar  and  so  we  just  state  the  result. 


■  Similarly 

)>{»/  =  0 ,Bf  =  1}  =  (1  -  -  (1  -  j)*-']. 

p{Hf  =  i  ,af  =  o)  =  (i  -  V-‘|i  -  I1  - 

1  g  q 

P{Hf  =  1,  Hf  =  1}  =  [1  -  (1  - 

The  transition  probabilities  of  the  Markov  chain  are  easily  determined  once 
g(i,fc)  =  P{Hf‘  =  »,  Hjt_1  =  k }  is  determined.  Let  a  =  (1  -  *)*-1  and 


IS 


I 


0  =  (1  -  J)*-1-  Then 

9(0, 0)  =  P{Ff  =  0,^=0} 

=  -4  £  p{/u^/;-.,/u-,^p>-i} 

9  /  1,/l/t.J— l 

=  i|?a  +  ?(»- 1)^| 

=  ia+(l-V 

9  9 

,(l,l)=P{H,‘=l,H*,  =  l}  =  i  £  P{/u€F,-i,/w-.  €/,.,} 

9  /i.y./i.j-i 

=  i(»(l  -a)  +  «(«-  1){2(1  -  a)  -  (1  -/))}] 

=  i(l-a)  +  (l-l)[2(l-a)-(l-/J)|. 

9  9 

Due  to  symmetry  it  is  easy  to  see  that  g(0, 1)  =  ?(1,0)  and  thus 


*(0,1)=«(1,0)  =  (l-«(0,0)-?(l,l))/2 

=  (l-i)(o-fl. 

We  now  turn  to  the  calculation  of  the  transition  probabilities  for  the  Markov 
chain. 


P{Hf  =  =  m!Hf_l  =  n}  = 


P{Hf=l,H?  =  m,H«i  =  n} 

P  W-i  =  n) 


For  the  case  l  =  0,  m  =  1,  n  =  0  the  numerator  in  the  above  expression  can  be 
written  as 


P{Hf  =  I,  H*  =  m,  Hf. ,  =n}  =  i  £  />{/,.,  *  t  Fj->}P{hj  6  #>}• 

9 
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Since  the  last  term  does  not  depend  on  fu  this  term  can  be  taken  out  of  the 
summation  we  have 


PiHj1  =  0,  Hf  =  1,  =  0}  =  P{Hf  =  0,  Hf^  =  1  }P{H?  =  0}. 

It  is  easy  to  see  that  these  operations  also  hold  for  any  value  f,m,n  so  we  have 
in  general  that 


P{Hf=l,H?  =  m,ff*1  =  n}  =  P{H}  =  /,  Hf.t  =  m)P{Hf  =  n}. 
Thus 

=  m) 

ns£.-»> 

g(/>n)p(m) 

p(») 

where  p(k)  =  P{fT*  =  £}.  Letting  a  =  (0,0),  6  =  (0, 1),  c  =  (1,0)  and  d  =  (1, 1) 
and  Pitl  =  P{Hf,Hf)  =  *|(#/_i>^£i)  =  1),  the  transition  probabilities,  are 
given  as 


Pa,.  =  Pa,«  =  p(0,0|0) 
P»,a  =  PI,*  =  p(0, 1|0) 
Pc, a  =  Pc,e  =  p(l,0|0) 
Pd, a  =  Pd,c  =  P(l»  1|0) 
P«,»  =  Pa,d  =  P(0,0|1) 


9  9 

9  9  a 

(1  -  i)(«  -  /»), 

(‘-jK-O 
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Pm  =  Pm  =  p( 0, 1|1)  =  (l  -  -)(a  -  /?), 

9 

PM  =  PM  =  P(1,0|1)  =  l~(l  —  a)  +  (1  —  ~)(2(l  —  a)  —  (l  —  /?))|(-r— — 

9  9  1  —  a 

P«  =  PM  =  P<  1,1|1)  =  i(l  -  a)  +  (1  -  i)[2(l  -  a)  -  (1  -  f)\. 


APPENDIX  C 


In  this  Appendix  we  give  a  few  sample  calculations  for  the  joint  distributions 
of  the  random  variable  Vy,  a  function  of  the  Markov  chain  W,  =  (Hf,  Hf,  Rj). 
That  this  is  a  Markov  chain  is  an  easy  consequence  of  the  fact  that  is 

a  Markov  chain  and  is  independent  of  {J2,  }  which  is  an  i.i.d.  process. 

First  let  Uj  =  with  a  =  (0,0),  b  =  (0, 1),  c  =  (1,0),  and  d  =  (1, 1). 

The  upper  bound  to  the  entropy  of  Vy  is  determined  from  the  joint  distribution 
of  Vy.  We  will  do  a  sample  calculation  of  the  joint  distribution  for  one  particluar 
argument  for  n  =  2  and  n  =  3  and  list  the  results  for  other  arguments.  The 
distributions  of  V}  will  be  calculated  in  terms  of  the  distributions  of  the  Markov 
chain  (7y  and  the  joint  distribution  of  the  process  {R,}-  Since  R,  is  an  i.i.d. 
process  the  joint  distribution  is  easy  to  calculate.  The  joint  distribution  of  Uj  is 
easily  calculated  since  it  is  a  Markov  chain. 

The  first  order  distribution  of  Vy  is  calculated  as  follows. 

P(V o  =  0)  .=  P{H0  =  0  or  Rc  =  0)  =  P{H0  =  0)  +  P{J0  =  l)P(f*o  =  0) 

=  P{U0  =  o)  4-  P(U0  6  B)P{Ro  =  0), 


P(V0  =  l)  =  P(jy0  =  l,i2o  =  l)  =  P(ffo  =  l)P(Po  =  1) 

-  P(U0  €  B)P(Ro  *  1). 


The  second  order  distribution  is  calculated  as  follows 


P(Vx  =  O,Vo  =  0) 


P{HX  =  0  or  Rx  =  0,  Ho  =  0  or  Rq  =  0) 

P{HX  =  0,  H0  =  0  or  Rq  =  0) 

+P{Hi  =  1,  R\  —  0,  Ho  =  0  or  Rq  =  0) 

P{HX  =0,H0  =  0)  +  P(HX  =  0,H0  =  l,iZo  =  0) 

+P(HX  =  1,RX  =  0,ff0  =  0)  +  P{HX  =  l,Rx=0,H0  =  l,Pb  =0) 

P(HX  =0,No  =  0)  +  P(Hx  =  0,  H0  =  1  )P(Ro  =  0) 

+P(HX  =  1,H0  =  Q)P{Ri  =  0)  +  P{HX  =  1,  =  0,  Rq  =  0) 

P{UX  =  a,  U0  =  a)  +  P(C/,  =a,U0e  B)P{Rq  =  0) 

+P(c/x  €  B,  u0  =  o)P(Px  =  o)  +  P(t/j  e  B,u0e  b)p{rx  =  o,Rq  =  o). 


Later  we  determine  the  joint  distribution  of  (f/i,  (70)  that  will  allow  us  to  complete 
the  calculation.  The  remaining  components  of  the  distribution  are  calculated  in 
a  similar  fashion  and  so  we  just  state  the  results. 

P[VX  =  0,^  =  1)  =  P[HX  =  0  or  jRx  =  0,if0  =  l>J2o  =  1) 

=  P{UX  =  a,U0€  B)P{Rq  =  1)  +  P{UX  €B,U0€  B)P{RX  =  0 )P{Rq  =  1) 
P{VX  =  1,V0  =  0)  =  P(HX  =  l,Px  =  1,H0  =  0  or  Rq  =  0) 

=  P(UX  €B,U0  =  a)P(Rx  =  1)  +  P{UX  €B,U06  B)P{RX  =  l)P{Ro  =  0) 


P(Vx  =  l,V0  =  l)  =  1  —  P(VX  =  1,  K0  =  0)  —  P(VX  =  0,  Vq  =  1)  -  P(VX  =  0,  V0  =  0). 
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For  n  =  3  the  joint  distribution  is  calculated  using  the  same  method  as  for  n  =  2. 
We  obtain 


P(Vj  =  0, =  0, VQ  =  0)  =  P(P,  =  0  or  R,  =  0,ff1  =  0  or  Pi  =  0,P0  =  0  or  Pq  =  0) 

=  P{Ui  =  a,Ut  =  a,U0  =  a) 

+P{Ui  =  a,  £/i  €  B,  U0  =  a)P(Pi  =  0) 

+P(tf,  =  a,  Ux  =  a,  U0  €  £)P(Pb  =  0) 

+P(Ut  =a,Ui6  B,U0  G  P)P(P,  =  0,Pb  =  0) 

+P(P,  G  P,  Ui  =  a,  IT0  =  o)P(P,  =  0) 

+P(P,  G  P,  Pi  G  P,  Uo  =  a)P(P,  =  0,  P,  =  0) 

+P(P,  €  B,lh  =  a,P0  G  P)P(Pj  =  0,Po  =  0) 

+P(P,  eB,uxe  B,Uo  G  P)P(P,  =  0^  =  0^  =  o), 

P(K,  =  1,  Vi  =  0,  K0  =  0)  =  P(£Tj  =  l.P,  =  lrPx  =  0  or  P,  =  0,P0  =  0  or  P,  =  0) 

=  P{Uj  G  P,  Pi  =  o,  Uo  =  a)P(P,  =  1) 

+P(P,  G  B.^e  P,P0  =  a)P(P,  =  l,Pt  =  0) 

+P(Pj  G  B,U\  =  a,  Uo  G  B)P(l?j  =  l,Po  =  0) 

+P(Pj  G  ByU\  G  P,P0  G  P)P(Pj  =  lf  Pi  =  0, Po  =  0), 

P(V,  =  0, Vi  =  1,^  =  0)  =  P(P,  =  0  or  P,  =  0, Pi  =  1,P,  =  1,P0  =0  or  Po  =  0) 
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=  P(Ba  =  a,ute  B,  Uo  =  a)P(Ri  =  1) 

+P(B ,  =a,Ul€  B,  Uq  e  B)P{Rl  =  l,Bo  =  0) 

+P(B,  G  B,  Bx  G  B,  U0  =  a)P(B2  =  0 ,Rl  =  1) 

+P(B,  G  B,  Ui  €  B,  B0  G  B)P(BS  =  0,  Bi  =  1,  Bo  =  0), 


P(V,=  l,Vi  =  l,Vb  =  0) 


—  1,  Bj  —  1,  =  1,  Bi  —  1,  Bo  =  0  or  Bo  =  0) 

P(Bj  G  B,  Bi  G  B,  Bo  =  a)P(Rj  =  1,  B,  =  1) 

+P(B2  G  B,Bt  G  B,U0  G  B)P(Bj  =  l.Bi  =  l,Bo  =  0), 


P(Vi  =  0,Vi  =0,V0  =  1)  =  P(B,  =  OorB,  =0,B1  =  OorB1=0,B0  =  l,B0  =  l) 

=  P(B,  =  a,  Ux  =  a,  B0  6  B)P(Bo  =  1) 

+P(Bj  =  a,B,  G  B,B0  G  B)P(B|  =  0,Bo  =  1) 

+P(Bj  G  B,Bi  =  a,  Bo  G  B)P(B,  =  0,Bo  =  1) 

+P(Bj  G  B,  Bi  G  B,  Bo  G  B)P(Bj  =  0,  Bj  =  0,  Bo  =  1), 


P(Vj  =  1»  Vi  =  0,  Vo  =  1) 


P(Bj  =  1,  Bj  =  l,Bi  =0  or  B1  =0,B0  =  l,Bo  =  1) 
P(BS  G  B,  B,  =  o,B0  G  B)P(B,  =  l,Bo  =  1) 

t 

+P(Bj  G  B,  Bj  G  B,  Bq  G  B)P(B2  =  1,  Bj  =  0,  Bo  =  1), 
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P(K,=  0,Vi  =  l,Vro  =  l)  =  P(Bj  =  0  or  Ri  =  0,  Hi  =  1,  Ri  =  1,  Ho  =  l,  Ro  =  l) 


=  P(B,  =  a,Ui€  B, U0  €  B)P(Ri  =  1, Bo  =  0) 


+P(B,  €  B,B,  6  B,B0  G  B)P{R,  =  0,/*i  =  l.Ho  =  1), 


P(V,  =  l,Vt  =  1,V0  =  1)  =  P[H,  =  l,Rt  =  l,Ht  =  l,Rl  =  l,H0  =  l,R0  =  l) 

=  P(B ,  €  B,  B,  6  B,  Vo  e  B)P(Rt  =  1,  Rt  =  1,  Bo  =  0). 


Now  since  By  is  a  Markov  chain  (10j 

P(Uj  =  o,  t/i  =  o,  U0  =  o)  =  P(Bj  =  a|Bj  =  o)P(f/i  =  a|B0  =  °)P(Bo  =  a) 

P(B ,  =  a,  =  «,  Vo  G  B)  =  P(B,  =  a|B|  =  a)P{Vx  =  a|B0  G  B)P(V0  G  B) 

P(Bj  =  a,  Vx  €  B,  Vo  =  «)  =  £  P(B,  =  «|tfi  =  7)P(B,  =  l\V0  =  «)P(B0  =  a) 

ir€B 

P(B,  =  a,  Vt  €  B,  B0  €  B)  =  £  P(B,  =  a|Bi  =  7)P(B,  =  7^0  G  B)P(V0  G  B) 

16  B 

P(B ,  €  B, =  o,  V0  =  a)  =  P(B,  €  B|Bi  =  a)P(B,  =  «|B0  =  a)P(B0  =  a) 

P(B ,  €  B,  Vt  =  a,  B0  G  B)  =  P(Ba  €  B|B*  =  a)P(B!  =  a|B0  G  B)P{V0  6  B) 

P(t/j  €  B,  Bt  €  B,  Bo  =  a)  =  £  P(B,  €  B|Bt  =  i)P(V \  =  7|B0  =  a)P(B0  =  a) 

t€B 

P(B,€B,B,€B,B0GB)  =  ^P(B,€B|B1=7)P(Bi  =  7|B0GB)P(B0GB). 

*»€B 


The  transition  probabilities  above  are  calculated  in  terms  of  the  transition  prob¬ 
abilities  of  the  Markov  chain  By  which  are  determined  in  Appendix  B. 

P(B y  =  «|By_x  =  a)  =  pa,B 
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P(Uj  =  a\Uj-i  e  B)  =  P(Ui=a,Uj-leB)/P(U,eB) 

[PjUj  =  a>Uj-\  =  b)  +  P(t/,  =  a,  Uj~i  =  c)  +  P(t/,  =  a,U,-i  =  d)\ 
P{Ui- !  =  4)  +  m_!  =  C)  +  P(U,- 1  =  d) 

_  Pa>Pt  +  Pa,ePe  +  PajPd 
Ph  ~  pe  +  pj 

P(C/,  6  B|C0_1  =  o)  =  P(tf,  =  6|cri_l  =  a)  +  P(C^  =  =  a)  +  P(£/,  =  dlty.j  =  a) 

=  P»,«  +  Pe.a  +  P<i,a 


for  any  integer  j. 

Now  consider  the  lower  bound  to  the  entropy,  namely, 


H(Vn\Vn-l,...,VuW0). 


Since  Rq  is  independent  of  V,  for  all  j  it  is  easy  to  see  that  this  entropy  is  the 
same  as 


H{V»\Vn-u...,VuU9). 

To  calculate  this  entropy  we  need  to  know  the  joint  distribution  of  (V„, Vi,  U0). 
The  bound  we  use  will  be  with  n  =  2.  The  second  order  distribution  is  given  as 
follows. 

P(Vj  =  0,  V\  =  0,  U0  =  i )  =  P(Hj  =  0  or  Rt  =  0,  Hi  =  0  or  Ri  =  0,Uo  —  i) 

=  P{Ht  =  0,JJ,  =  0,U0  =  i) 

+P(ff,  =  0 ,  J/i  =  1  ,RX  =  0  ,U0  =  i) 

■ \-P{H j  =  l,Pj  =  0yH\  —  0,  Uq  =  i) 

+P(ffj  =  1,  Rj  =  0,  H\  —  1,  Ri  —  0,  U0  =  i) 
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=  P{Hi=0,Hl  =  0,U0  =  t) 

-hP(P,  =  0  ,Hi  =  1,  U0  =  i)P{Ri  =  0) 

+P(P,  =  1,  Hi  =  0,tf„  =  =  0) 

+P{Ha  *  l,ffi  =  l,tf0  =  =  0,i2i  =  0) 

=  P(t/j  =  a,  I/i  =  a,  t/0  =  *) 

+P(C/j  =  a,  Ux  e  B ,  C/0  =  *)  W  =  0) 

+P(tf,  eB,Ul  =  a,  t/o  =  *')P(Pi  =  0) 

+P(I/,  6  P,  Ut  eB,U0  =  i)P{Rt  =  0,  Ri  =  0), 


P(Vj  =  1,  Vj  =  0,  t/o  =  i) 


P(P,  =  1,P,  =  l,  Hx  =  0  or  Rt  =  0,tf0  =  »') 
P(tf,  €  P,t/i  =  o,  Wo  =  OW  =  1) 

+P(tf,  €  B,UX  €  P,E/0  =  t)P(P,  =  !,«!=  0), 


P(Vi  =  0,Vl  =  l,V0  =  i)  =  P(2?i  =  0  <?r  Pi  =  0,  £Ti  =  1,  Pi  =  1,  Uo  =  *') 


=  P(tf,  =  a,  C7X  €  P,  Vo  =  »)P(Pi  =  1) 

+P(t/,  €  P,  €  B,U0  =  i)P(P,  =  0,PX  =  1), 


P(Vj  =  l,Vi  «  1,  €70  =  0  =  P(P,  =  l,PJ  =  l,Pi  =  l,P1  =  l,Po  =  «) 

=  P(tf8  eB,uxe  P, Uo  =  t)P(Pj  =  i, p»  =  i). 


1 


j 


I 


-j 

J 


I 


I 


I 
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(«)  Chattel  A 


(b)  Chattel  B 


,  2.  Channel  models  for  synchronous  frequency 

hopped  spread-spectrum  communications  system 
(a)  with  side  information,  (b)  without 
side  information. 


(OlOO)d 


Markov  chain  for  frequency-hopped  spread-spectrum  multiple-access  communications. 


Normalized  Sum  Capacity 


Fig.  5.  Normalized  sum  capacity  for  synchronous 
hopping  with  q  *  50. 


Number  of  Users,  K 


Fig.  6.  Normalized  sum  capacity  for  asynchronous 
hopping  with  q  -  50. 


